Inter-Rater Agreement Study on Readability Assessment in Bengali
نویسندگان
چکیده
منابع مشابه
Inter-Rater Agreement Study on Readability Assessment in Bengali
An inter-rater agreement study is performed for readability assessment in Bengali. A 1-7 rating scale was used to indicate different levels of readability. We obtained moderate to fair agreement among seven independent annotators on 30 text passages written by four eminent Bengali authors. As a by product of our study, we obtained a readability-annotated ground truth dataset in Bengali.
متن کاملComparison between inter-rater reliability and inter-rater agreement in performance assessment.
INTRODUCTION Over the years, performance assessment (PA) has been widely employed in medical education, Objective Structured Clinical Examination (OSCE) being an excellent example. Typically, performance assessment involves multiple raters, and therefore, consistency among the scores provided by the auditors is a precondition to ensure the accuracy of the assessment. Inter-rater agreement and i...
متن کاملInter-rater Agreement on Sentence Formality
Formality is one of the most important dimensions of writing style variation. In this study we conducted an inter-rater reliability experiment for assessing sentence formality on a five-point Likert scale, and obtained good agreement results as well as different rating distributions for different sentence categories. We also performed a difficulty analysis to identify the bottlenecks of our rat...
متن کاملOn Inter-rater Agreement in Audio Music Similarity
One of the central tasks in the annual MIREX evaluation campaign is the ”Audio Music Similarity and Retrieval (AMS)” task. Songs which are ranked as being highly similar by algorithms are evaluated by human graders as to how similar they are according to their subjective judgment. By analyzing results from the AMS tasks of the years 2006 to 2013 we demonstrate that: (i) due to low inter-rater a...
متن کاملInter-rater agreement of paramedic rhythm labeling.
STUDY HYPOTHESIS Substantial inter-rater agreement is present in the labeling by paramedics of ventricular fibrillation and asystolic rhythms. DESIGN Prospective, cross-sectional study. TYPE OF PARTICIPANTS One hundred five practicing paramedics from nonvolunteer agencies who are advanced cardiac life support certified. METHODS Five static cardiac arrest rhythm strips, classified by Cummi...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: International Journal on Natural Language Computing
سال: 2014
ISSN: 2319-4111,2278-1307
DOI: 10.5121/ijnlc.2014.3303